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, Abstract. Our main aim is to present a geometrically meaningful formula for the 

' fundamental solutions to a second order sub-elliptic differential equation and to the 

heat equation associated with a sub-elliptic operator in the sub-Riemannian geometry 
on the unit sphere S'^. Our method is based on the Hamiltonian approach, where the 
, corresponding Hamitonian system is solved with mixed boundary conditions. A closed 

^\ ' form of the modified action is given. It is a sub-Riemannian invariant and plays the 

, role of a distance on 

P.- 

1. Introduction 
The unit 3-sphere centered on the origin is a subset of defined as 



> 

. §^ = {{xi,X2, X3, X4) G : xl + xl + xl + xl = 1)}. 

^ I Regarding as the space of quaternions H, the above unit 3-sphere admits the form 

S' = {qem: \q\' = l)}. 

^ ' This description represents the sphere §^ as a set of unit quaternions with the inherited 

O ■ group structure, and it can be considered as the spin group Sp{l), where the group 

operation is just the multiphcation of quaternions. Let us identify M.^ with pure imag- 
^ ; inary quaternions. The conjugation qhq of a pure imaginary quaternion h with a unit 

^ ■ quaternion q defines rotation in M^, and since \qhq\ = \h\, the map h \—>- qhq defines a 

^ ■ two-to-one homomorphism Sp{l) SO (3). The Hopf map vr : ^ §^ can be defined 

by 

§^ 9 g gig = 7r(g) G 

In its turn, the Hopf map defines a principle circle bundle also known as the Hopf bundle. 

The sub-Riemannian structure of comes naturally from the non-commutative group 
structure of the sphere in the sense that two vector fields span the smoothly varying 
distribution of the tangent bundle, and their commutator generates the missing direction. 
The missing direction is also can be obtained as an integral line of the Hopf vector field 
corresponding to the Hopf fibration. The sub-Riemannian geometry on was studied 
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in pn [T9l [25] , see also [H]. Explicit formulas for geodesies were given in [19]. Let 
us mention that the word 'geodesic' in our terminology stands for the projection of 
the solutions to a Hamiltonian system onto the underlying manifold, that is a good 
generalization of the notion of geodesic from Riemannian to sub-Riemannian manifolds, 
see for instance [331 [38] • The Lagrangian approach was applied in [17] and [25] in order to 
characterize and to find the shortest geodesies. Another approach based on the control 
theory was employed in [H] . 

In this paper, our main aim is to deduce a geometrically meaningful formula for the 
Green function for a second order sub-elliptic differential operator and the heat kernel 
associated with this operator in the sub-Riemannian geometry on the unit sphere S'^. 
There exists a vast amount of literature studying sub-elliptic operators based on different 
methods. Here we give only few possible references [HI |23l [2S1 EH EH] • The exact 
form of the heat kernel on sub-Riemannian manifolds was obtained only in some simple 
particular cases. Namely, in the case of the Heisenberg group, the representation theory 
was used in [27], the probability approach was developed in [22], the Laguerre calculus 
was applied in p], and the Hamilton- Jacobi approach one finds in [9]. Recently, the 
heat kernel was investigated on other low dimensional sub-Riemannian manifolds. The 
representation theory was exploiting in [2] and spectral analysis and small time 
asymptotics were used in [5]. Our method is based on the Hamiltonian approach which 
benefit is the connection between the heat kernel and the geometry of the sphere as a 
sub-Riemannian manifold. Analogously to Hadamard's method for strictly hyperbolic 
operators, our method essentially uses three important ingredients: 

• Solution of the Hamiltonian system with non-standard boundary conditions and 
construction of a modified action on solutions to this systems. This modified 
action plays the role of a sub-Riemannian distance; 

• Solution of the corresponding transport equations and deduction of the volume 
elements. 

• Integration of the modified action over the characteristic variety with respect the 
measure defined by the volume element. 

This method was realized for the two step nilpotent groups, for instance, in series of 
papers [SJ [H [9] , where the geometric meaning of the fundamental solutions was revealed. 
For other geometries see, for example [TTl \TU\ [TS] . The case of 3-sphere reveals new 
features, and possessing the Cartan decomposition of the acting group, it is not a direct 
analog of previous considerations. 

The structure of the paper is as follows. The classical setup for the heat kernel in 
the Riemannian case is presented in Section 2. In Section 3, we define the horizon- 
tal distribution and the sub-Riemannian metric. The Hamiltonian system is derived 
in the fourth section. In the fifth section we treat the problem of finding geodesies as 
an optimal control problem. Symmetries of the Hamiltonain system are discussed. In 
Section 6, we solve the Hamiltonian system to find geodesies and to solve the boundary 
value problem. The number of geodesies connecting two fixed points on §^ is studied. 
Both cartesian and hyperspherical coordinates are used. At the end of this section we 
define the modified action and investigate its properties. Special directions in the cotan- 
gent bundle given by the Hamiltonian system are revealed clearly in the hyperspherical 
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coordinates contrasting with the cartesian ones. We use these directions to construct 
the modified action solving the Hamiltonian system with non-standard mixed boundary 
conditions. The modified action satisfies a generahzed Hamilton- Jacobi equation (Sec- 
tion 7). It is a sub-Riemannian invariant on §^ and it is used for the construction of a 
distance function (Section 8). The distance function is involved into the fundamental 
solutions to the sub-Laplacian equation and to the heat equation associated with the 
sub-Laplacian. The concluding Section 9 is concerned with the volume element. The 
sub-Laplacian and the heat operator associated with this sub-Laplacian are not elliptic, 
they degenerate along a singular manifold of dimension one in the cotangent space. The 
fundamental solutions to these equations can be obtained by integrating the distance 
function over this one-dimensional singular set which is the characteristic variety of the 
corresponding Hamiltonian with respect of a special measure with the density called 
the volume element. Unlike the case of nilpotent groups the volume element depends 
on phase variables that does not permit to find its explicit form. Instead we present 
differential equations, called the transport equations which solutions give the necessary 
volume elements. 

The paper was initiated when the authors visited the National Center for Theoretical 
Sciences and National Tsing Hua University during May 2008. They would hke to 
express their profound gratitude to Professor Jing Yu for the invitation and for the 
warm hospitality of the staff extended to them during their stay in Taiwan. 

2. He AT KERNEL IN 

Let us present some simple calculations in for the heat operator motivating further 
generahzations to the case of sub-Riemannian geometry on S^. Let A = ^ I^j=i (af") 
be the Laplace operator. Then the kernel Pu{x, Xq) for the operator A — ^ is given by 

[Ztiu) 2 

If we write / = ||a; — XqP, then it is easy to see that the function ^ satisfies the 
Hamilton- Jacobi equation 

and H is the Hamiltonian function associated with the Laplace operator A. In the 
standard theory, the function S — ^is the classical action related to the Hamiltonian H. 

In the case of a general second order elliptic operator defined by smooth linearly 
independent vector fields Xj, j — l,...,n in R", the heat kernel Pu{x,xo) for the 
operator 

d_ 

d^' 2 



Ax-i^, with Ax = IJ2^1 



admits the form 



Pu{x,Xo) ^ — -ne~ 2« (^y^^ y^u y^u + ...), 

[ZTru) 2 



4 



DER-CHEN CHANG, IRINA MARKINA, AND ALEXANDER VASIL'EV 



where the function still satisfies the Hamilton- Jacoby equation with respect to the 

vector fields Xj. Associated Hamiltonian is degenerating only at one point of M" x R" 
and the constants vi are chosen so that the delta function supported at xo is clearly seen. 

Let us consider the vector fields Xi, . . . , X^ satisfying the Chow-Rashevskii (or bracket 
generating) condition [201 ES] (see Section 3) on n-dimensional manifold M, k < n. In 
this case the operator Ax = | Sj=i -^j is sub-elliptic and degenerates over a set of 
positive measure. Previous studies (see, e.g., [6l [H [U [TOl [TTl [18] ) show that it is 
reasonable to expect the heat kernel Pu{x,Xq) for the operator associated with the sub- 
Laplacian Ax in the form 

Pu{x^xo) = — [ e~ ' "° \{x, u, t) dr. 



chv{H)x„{r) 

Here chv{H)xQ is the characteristic variety of the Hamiltonian function at xq associated 
with the sub-Laplacian Ax defined by 

chv{H) = {(x,0 e T*M : H{x,0 = O}- 

The characteristic variety represents the singular set of the sub-elliptic operator. The 
function f{x, xq, t) plays the role of square of the distance between the points xq and x 
on the manifold M and satisfies the generalized Hamilton- Jacobi equation 

rf + H{x,VJ) = f. 
dr 

The function / is a modified action associated with the degenerating Hamiltonian. The 
term f(x,r) is a suitable measure on the characteristic variety chv{H)^f^ at Xq making 
the integral convergent. It is called the volume element and it can be found from a 
differential equation known as the transport equation. 

The following sections will be devoted to the study of the Hamiltonian system, its 
solutions and the construction of the modified action function / as a distance function 
in the heat kernel associated to the sub-elliptic operator on S'^ . 

3. Horizontal distribution on 

Let us turn to the sub-Riemannian geometry on S^. In order to calculate left-invariant 
vector fields we use the definition of S'^ as a set of unit quaternions equipped with the fol- 
lowing non-commutative multiphcation 'o': if x = (xi, 0:2, X3, 0:4) and y = (2/1, 1/2, ?/3, 2/4), 
then 

x o y = (xi,X2,a;3,X4) o (^1,2/2,1/3,1/4) = ((a;i2/i - a;2i/2 - 3^32/3 - 3^42/4), 

{x2yi + xiy2 - X4I/3 + 3:32/4), 
(3.1) (xsyi + X42/2 + Xiy3- X22/4) , 

{x4,yi - X3y2 + X22/3 + xiy^) 

The rule fl3.ll) gives us the left translation L^^y) of an element y = (2/1,2/2,2/3,2/4) by 
an element x = {xi,X2,Xs,X4). The left-invariant basis vector fields are defined as 
X{x) = (L2:(2/))*X(0), where X{0) are the basis vectors at the unity of the group. 
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Calculating the action of (L^(?/))* in the basis of the unit vectors of we obtain four 
left- invariant vector fields 

Xi{x) = xidxi + X2dx2 + ^3dx3 + Xid^^, 

(3.2) ^2(3;) = -xa^^i + xid^^ + X49^3 - Xg^^^, 

-^3(2;) = -x-id^^ - x^dx.^ + xid^^ + X2(9^4, 

Xi{x) = -X4(9^i + x^d^., - X2dx., + xid^^. 

It is easy to see that the vector Xi{x) is the unit normal to S'^ at x with respect to the 
usual inner product (-, ■) in M^, hence, we denote Xi{x) by N. Moreover, the vector 
fields X2(x), X^{x)^ -^4(2;) form an orthonormal basis of the tangent space T^-S^ with 
respect to (■, ■) at any point x G S'^. Let us denote these vector fields by 

X3 = X, X4 = y, X2 = Z. 

The vector fields possess the following commutation relations 

[X, F] = xy - FX = 2Z, [z, X] = 2y, [r, z] = 2X. 

Let V = span{X, Y} be the distribution generated by the vector fields X and Y. Since 
[X, Y] = 2Z ^ V, it follows that V is not involutive. The distribution V will be called 
horizontal. Any curve on the sphere with the velocity vector contained in the distribution 

V will be called a horizontal curve. Since T^S^ = span{X, F, Z = 1/2[X, F]}, the 
distribution is bracket generating at each point x E E>^, see [201 ES]- We define the 
metric on the distribution T> as the restriction of the metric (-, ■) to T>, and the same 
notation (-, ■) will be used. This metric coincides with the metric given by the Killing 
form on the Lie algebra T^S^. Finally, the manifold (S^, (■, ■)) becomes a step two 
sub-Riemannian manifold. 

Remark 1. Observe that the choice of the horizontal distribution is not unique. The 
relations [Z, X] = 2Y and [Y, Z] = 2X imply possible choices V = span{X, Z} or V = 
span{y,Z}. The geometries defined by different horizontal distributions are cyclically 
symmetric, so we restrict our attention to the distribution V = spanjX, Y}. 

Remark 2. Let us define two rotations in the planes (xi,X2) and ( X3, X4) as 

X = (xi, X2, X3, X4) 1-^ -Ri^(x) = (xi cos — X2 sin 0, xi sin + X2 COS0, X3, X4), 

X = (xi, X2, X3, X4) 1^ -R2^(x) = (xi, X2, X3 COS0 — X4 sin 0, X3 sin + X4 cos 0). 

It is easy to see that these transformations leave S'^ invariant. The vector fields X and 

Y change under these rotations as follows. Under the rotation Ri^ we have 

X ^^ X = X COS + y sin 0, Y t-> Y = -X sin + F cos 0, 
and under the transformation Ro^ we have 

X \—>- X = X COS — y sin 0, Y \—>- Y = X sin + F cos 0. 

Since [X,y] = [X, F], we conclude that these transformations preserve the horizontal 
distribution. In both cases the sub-Laplacian is also invariant = X^ + y^ = X^ + y^. 
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We also can define the distribution as a kernel of tlie following one-form 

(3.3) u) = —X2dxi + Xidx2 + X4dx3 — x^dx^ 
on R'^. One can easily check that 

uj{X) = 0, uj{Y)=0, uj{Z) = 1^0, uj{N) = 0. 

Hence, the horizontal distribution D^, at x G §^ can be written as kerUrcnT^Si^. The one- 
form u has the following geometric meaning. It is the difference of two independent area 
forms a = —X2dxi + Xidx2 in (xi, X2)-plane and j3 = —x^dx^ + x^dx^ in (xs, X4)-plane. 

Let 7(5) = {xi{s),X2{s),X3{s),X4{s)) be a curve on Then the velocity vector, 
written in the left-invariant basis, is 

7(s) = a(.)X(7(s)) + b{s)Y{^is)) + c{s)Z{^is)), 

where 

a = (7, X) = — X3X1 — X4X2 + X1X3 + X2X4, 

(3.4) b = (7, Y) = — X4X1 + X3X2 — X2X3 + X1X4, 
c = (7, Z) = -X2X1 + X1X2 + X4X3 - 0:3X4. 

The following proposition holds. 

Proposition 1. Let 7(5) = (xi(s), X2(s), X3(s), X4(s)) he a curve on S^. The curve 7 is 
horizontal, if and only if, 

(3.5) c = (7, Z) = — X2X1 + X1X2 + X4X3 — X3X4 = 0. 

If we take into account the geometric meaning of the one-form u, then we can refor- 
mulate Proposition [1] in the following way. Let us denote by A the area swept by the 
projection of the horizontal curve 7 onto the (xi, X2)-plane and bounded by the straight 
line connecting its ends, and by B we denote the analogous area swept by the projection 
of the horizontal curve onto the (X3, X4)-plane. 

Proposition 2. Let 7(5) = (xi(s), X2(s), X3(s), X4(s)) be a curve on and let A, B he 
as introduced above. Then, the curve 7 is horizontal, if and only if, A = B. 

The manifold is connected and it satisfies the bracket generating condition. By the 
Chow-Rashevskii theorem [20[|35], there exist piecewise horizontal curves connecting 
two arbitrary points of In fact, smooth horizontal curves connecting two arbitrary 
points of S'^ were constructed in [T71 [TU] . 

Proposition 3. The horizontality property is invariant under the left translation. 



Proof. It can be shown that (13.41) does not change under the left translation. This implies 
the conclusion of the proposition. □ 
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Figure 1. Projections of 7 to the planes (xi,X2) and (x3,a;4) in Proposition [2] 



4. Hamiltonian system 

Once we have a system of curves, in our case the system of horizontal curves, we can 
define their length as in the Riemannian geometry. Let 7 : [0, t] — §^ be a horizontal 
curve such that 7(0) = x, ■y(t) = y, then the length /(7) of 7 is defined as follows 

(4.1) /(7)= !\i,i)"^ds= f {a\s)+h\s)Y"ds. 

Jo Jo 

Now we are able to define the distance between two points x and y by minimizing 
integral (14.11) or the corresponding energy integral (^^(s) + &^(s)) ds under the non- 
holonomic constraint (13.51) . This is the Lagrangian approach. The Lagrangian formalism 
was applied to study sub- Riemannian geometry on §^ in pTt 125] . In Riemannian ge- 
ometry the minimizing curve locally coinsides with the geodesic, but it is not the case 
for sub-Riemannian manifolds. Interesting examples and discussions can be found, for 
instance, in [29| [ST j [32l [33l [38] . Given the sub-Riemannian metric we can form the Hamil- 
tonian function defined on the cotangent bundle of S^. A geodesic on a sub-Riemannian 
manifold is defined as the projection of a solution to the corresponding Hamiltonian 
system onto the manifold. It is a good generalization of the Riemannian case in the 
following sense. The Riemannian geodesies (which are defined as curves with vanishing 
acceleration) can be lifted to the solutions of the Hamiltonian system on the cotangent 
bundle. 
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Let US construct and describe sub-Riemannian geodesies on (S^yV, (■,■)). The left- 
invariant vector fields X, Y, Z can be written using the matrices 



In fact, 







1 
1 



-1 

-1 










1 





1 

-1 





-1 






-1 



1 
















1 

-1 



X = {hx, Vx), Y = {I2X, Vx), Z= {I3X, Vx) . 
The Hamiltonian is defined as 



or 

(4.2) 



H 



1 



2' ^ " ^ 2 

where ^ = Vx. Then the Hamiltonian system follows as 

dH 

dH 



X 



X 



(4.3) 



{hx,0 ■ ihx) + {l2X,0 ■ {hx) 



dx 



^ = {hx,o-iho + {i2x,o-im- 



As it was mentioned, a geodesic is the projection of a solution to the Hamiltonian system 
onto the x-space. We obtain the following properties. 

1. Since {Iix,x) = (J2X, x) = (J3X, x) = 0, multiplying the first equation of (14.31) 
by X, we get 



X 



const. 



(x, x) = = 

This asserts that any solution to the Hamiltonian system belongs to the sphere. 
Taking the constant equal to 1 we get geodesies on 

2. Multiplying the first equation of (14.31) by /3X, we get 

(4.4) (x,J3x) = 0, 

by the rule of multiplication for Ji, I2, and I3. The reader easily recognizes the 
horizontality condition {x,Z) = in (14. 4p . It means that any solution to the 
Hamiltonian system is a horizontal curve. 

3. Multiplying the first equation of (14.31) by Jix, and then by /2X, we get 

(^,/lx) = (x,Jix), (^,x/2) = (x,x/2). 

On the other hand, we know that (x, Jix) = a and (x, x/2) = b. The Hamiltonian 
can be written in the form 

H = l {{hx, 0' + {I2X, 0') = \ {{hx, x)' + {hx, x)') = l {a' + b') . 

Thus, the Hamiltonian gives the kinetic energy H = which is constant along 
the geodesies. 
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4. If we multiply the first equation of (14.31) by x, then we get 

|i;|2 = (^j^x, 0^ + {hx, 0^ = {hx, xf + (J2X, xf = a^ + b'^ = 2H. 
Therefore 

(4.5) |xp = a2 + 6l 



The following theorem was proved in [12] and 

Theorem 1. The set of geodesies with constant velocity coordinates starting from the 
point (1, 0, 0, 0) forms the unit sphere in parametrized as 

(coss, 0, cosip sins, sinip sins), s G [0,7r], ip E [0,27r). 

The integral line corresponding to the vertical vector field Z starting from the point 
(1,0,0,0) is parametrized as (coscj, sincj, 0, 0), u G [0, 27r). 

Remark 3. For the arbitrary reference point the horizontal geodesies are parametrized 
by 

x(s) = xq cos s + (Ji COS + I2 sin ■ip)xo sin s, 
and the vertical line by 

x{s) = Xq cos s + I3X0 sin s, 

see [IS]. 

5. Optimal control viewpoint 

The above Hamiltonian system and calculation of geodesies admits the optimal control 
interpretation. The interplay of the control theory and sub-Riemannian geometry has 
been well known since early 80s. One of the pioneering contributions was made by Brock- 
ett P-5J. He considered a time optimal control problem leading to the sub-Riemannian 
geometry in R^, or to the Heisenberg group. His results then were generalized in several 
ways, see e.g., |30]. Several results, already known by this time due to the fundamental 
Gaveau's work [22j, were rediscovered and the problem of finding normal and abnormal 
geodesies was formulated in terms of the optimal control, see e.g., [H [21] • Pontrya- 
gin's maximum principle provides such optimal controls. Interesting features of such 
Hamiltonian systems are symmetries given by the first integrals although such systems 
generally are not (Frobenius) integrable because of singular geometric background, i.e., 
constraints on the velocities can not be re-written in terms of the configuration coordi- 
nates. A good reference to the control theory viewpoint is |12j . 

Let us consider the following time optimal control problem given by the system 



(5.1) 

with the cost functional 



Xi = —UX3 — VX4^ 

X2 = —UX4 + VX3, 

X3 = UXi — VX2, 

Xi = UX2 + VXi, 



1 



^ = 2 / (u, u)ds. 







where u = {u,v). The functional E represents the total kinetic energy. The system is 
encoded in the kernel of the contact 1-form (13. 3p . 



10 



DER-CHEN CHANG, IRINA MARKINA, AND ALEXANDER VASIL'EV 



The pseudo-Hamiltonian given by the Pontryagin Maximum Principle for this system 
admits the form 

(5.2) H = -^{U^ + v'^) + U(-X3^i - X4^2 + Xi^3 + + v{-Xa^i + X3^2 - + ^^l^), 

and the system for covectors becomes 

(5.3) f = -<^ + <3, 

L = <2 + <l- 

The system ( 15.11 - 15.31) for position coordinates may be rewritten in the following form 

U = —X3X1 — X4X2 + X1X3 + X2X4, 
V = — X4X1 + X3X2 — X2X3 + X1X4, 

= —X2X1 + X1X2 + X4X3 — X3X4, 
= xiXi + X2X2 + X3XS + X4X4, 

which has a clear geometric meaning. Indeed, u and v are the coefficients of the velocity 
vector uX + vY, the third equation is just the horizontality condition and the fourth 
means that the trajectory belongs to a sphere. 

From the Hamiltonian system one derives four first integrals 

Jl = Xi^l + X2^2 + X3^3 + X4^4, 

J2 = -X2^1 + Xi^2 + 3^46 - 2:3^4, 

J3 = -Xs^l + X4^2 + - X2^4, 

J4 = -X4^1 - X3^2 + X2^3 + Xi^4. 

The Poisson structure is given by the Poisson brackets 



^ dF dG dG dF 



k= 



^ dxk d^k dxk d^k 



The integrals Ji and J2 represent natural symmetries (following two natural geometric 
conditions: Ji is the normal covector and J2 gives the horizontality condition) and 
J3, J4 give hidden symmetries. All first integrals are involutive in pairs [Jk, Jm] = 0, 
k,m = 1, ... ,4, which implies Liouville integrabilty of the above Hamiltonain system. 
Observe, that the Hamiltonian system for the Heisenberg group is not Liouville integrable 
as well as the Hamiltonian system corresponding to sub-Riemannian geometry on SO{n) 
for n > 4, see [T51 Let us remark that the optimal control problem in the sub- 
Riemannian geometry on SO{n) can be viewed as the problem of optimal laser-induced 
population transfer in n-level quantum systems, see [13] . 

In order to find geodesies we can use the Pontryagin Maximum Principle [31] which 
states that any normal geodesic is a projection of a bichar act eristic which is a solution 
to the above Hamiltonian system on the cotangent bundle with the control u* which 
maximizes the pseudo-Hamiltonian Ti, i.e., satisfies the equation 

on on ^ 
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This problem is equivalent to the geometric problem of minimizing the Carnot-Carathe- 
odory distance (or, equivalently, sub-Riemannian energy) in the optimal control problem 
for our control-linear system. The optimal control admits the form 

Substituting u* in the Hamiltonian system we obtain the geodesic equation (14.21) and 
(14. 3p . The importance of integrability of the sub-Riemannian geodesic equation was 
argued by Brockett and Dai fT6], who showed the explicit integrability in some special 
cases in terms of elliptic functions and discussed applications to controllability problems. 
But the question of integrabilty of Hamiltonain systems associated with nonholonomic 
distributions has a long history, see the survey [IQ] for the historical account. 

As it was shown in [21], abnormal geodesies are not geometrically relevant for step 2 
groups. Nevertheless, we give here independent treatment of abnormal geodesies from 
the Pontryagin Maximum Principle viewpoint. The pseudo-Hamiltonian in this case 
becomes 

The Pontryagin Maximum Principle implies that Tio vanishes along the extremal. We 
can assume that the velocity coordinates u and v do not vanish simultaneously. After 
differentiating J3 and J4 along the extremal we obtain 

Q = j^ = [j.,,n^] = -2vJ2, 

= ^4 = [J4,7^o] = 2mJ2. 

Let us suppose that u does not vanish on some time interval s & U . Then, J2 = on 
this interval, and being the first integral, it is vanishing everywhere. Then we obtain 

= = [^2,^0] = -2m J4, 

and J4 is identically by the same reason. Therefore, J3 = 0. Solving the system 
Jfc = 0, A; = 1, . . . , 4, with respect to Xk we see that the discriminant of this system is 
1. Fixing initial conditions for the Hamiltonian system (I5.1H5.3I) we deduce that = 0, 
/c = 1, . . . , 4, and only stationary solution is valid. 

For normal geodesies we have that along the extremal 

n = H = ^(-3:3^1 - 0:4^2 + Xi^3 + X2U)^ + ^{-X4^i + X3^2 " 3^2^ + Xi^^Y , 

and is given as in (14. 2p . 

6. GeODESICS AND MODIFIED ACTION 

6.1. Cartesian coordinates. Fix the initial point a;*^°^ = (1,0, 0, 0). It is convenient to 
introduce complex coordinates z = Xi+ix2, w = x^ + ix^, ip = ^i + i^2, and ip = + 
Hence, the Hamiltonian H admits the form H = ^\wip — ztp]"^ (compare with (I4.2p ). The 
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corresponding Hamiltonian system becomes 

i — w{w(p — z'ljj), z{0) = l, 

w = —z{w(p — zip), w(0) = 0, 

(/9 = ijj^wip — Zip), (f{0)=A — iB, 

ip = —(p{wip — zil)), ijj{0) = C — iD, 

and H = |Re {zcp + wip). Here the constants B, C, and D have the following dynamical 
meaning: w{0) = C + iD, and B = —iw{0)/2w{0) or if we write in real variables, 
C = i;3(0), D = X4{0), B = \{xs{0)x40) - x40)x3{0))/{xl{0) + xl{0)). If we denote 

then I A; I is the curvature of a geodesic at the initial point. This complex Hamiltonian 
system has the first integrals 

zip — wip = C + iD, 
z(p + wip = A — iB, 

and we have |2;p + |wp = lasa normalization. Therefore, 

(f = z{A + iB) -w{C + iD), 
-iP = zlc + iD) +w{A + iB). 

Let us introduce an auxiliary function p = w/z. Then substituting (p and ip in the 
Hamiltonian system we get the equation for p as 

p= {C + iD)p^ -2iBp+ {C -iD), p(0) = 0. 

The solution is 



(C - iD) sm(sVB^ + C^ + D^ 

p{s) 



^/WTC^TW cos{sVB^ + C2 + D^) + iB sm{sVB^ + + D^) ' 

Taking into account that zz = —ww, we get the solution 
(6.1) 

zis) = ( cos(sVB^ + C'' + D^) +i — ^ sm( sVB^ + + D^)] e''^', 

\ VB^ + C^ + D^ ^ 7 

and 

(6.2) wis) = , ^ + ^ sin(s^/S2 + C2 + L»2)e^^^ 

^ ' ^ ' VB^ + C^ + D^ ^ ' 

Remark 4. Let us consider three limiting cases, li B — Q, then we get the solutions with 
constant horizontal velocity coordinates 

z{s) = coss, w{s) = (0:3(0) + ix4{0)) sins 

which lie on the horizontal 2-sphere, and a geodesic joining two given points on it is 
unique. If C^ + D'^ = 0, then the only solution w{s) to the Hamiltonian system is w{s) = 
0. The horizontality condition in this case is read as X2X1 — X1X2, and the solution is a 
straight line which contradicts the condition = 1. So if = ^{C^ + D'^) > 0. 

Now we want to find geodesies joining two given points. 
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Theorem 2. Let Q be a point of the vertical line, i. e. Q = (cosu;, sinu;, 0, 0), u G 
(— TT, 0) U (0, tt), then there are countably many geometrically different geodesies 7„ con- 
necting P = (1, 0, 0, 0) with Q. They have the following parametric representation 

f 7m uj Tcn. 
(6.3) Zn{Sj = cos(s — )—i — sm(s — 

V t Tin t ' 

vrn t 



n E Z \ {0}, s G [0,t], and the length of geodesies 7„ is given as In = -^^/l 

Proof. The geodesies are parametrized in the time interval s G [0,t]. If the point Q 
{z{t),w{t)) = {z,w) belongs to the vertical line starting at P = (1,0,0,0), then \z\ = 
and = provided that —Bt = a;, in what follows, 

cos^ (tVB^ + C^ + D^) + — sin" {t^/WTC^TD^) = 1, 



sin(tVS2 + C2 + D^) = 0, -Bt = uo. 

These equations imply 

TTTI 

(6.4) t = = > 0, -Bt = u. 

The latter relations give 



Substituting (16. 4p in the solutions to the Hamiltonian system we come to the parametric 
representation given in the formulation of the theorem. The first relation of (16.41) yields 

+ = i^(7rn)2-cj2_ 
The length of each geodesic is given as 

In = ty/H = -^VC + = -^V(7rn)2-a;2_ 

This finishes the proof. □ 

Remark 5. In the formulation of the theorem the words 'geometrically different' mean 
that due to the rotation of the argument oi C + iD in w(s), there exist uncountably 
many geodesies. 

So far we have had a clear picture of trivial geodesies whose velocity has constant co- 
ordinates. They are essentially unique (up to periodicity). The situation with geodesies 
joining the point (1, 0, 0, 0) with the points of the vertical line has been described in the 
preceding theorem. Let us consider the generic position of the right endpoint (-z,w), 
z = re*^^, w = pe^^^ on 

Remark 6. First we consider three limiting cases. If p = 1, then B = and r = 0, and 
the point lies on the horizontal 2-sphere. If p = 0, then sm{ty/B'^ + + D"^) = and 
the point z = ±(cos(-Bt) — i sm{Bt)), w = belongs to the vertical line. If arg^r = 0, vr, 
then z = ±r, w = ±-\/l — r2(cos^2 + isin^2) is a point on the horizontal 2-sphere. 



14 DER-CHEN CHANG, IRINA MARKINA, AND ALEXANDER VASIL'EV 

In other situations we have the following theorem. 

Theorem 3. Given an arbitrary point {z, w) G §^ which neither belongs to the vertical 
line nor to the horizontal sphere S^, there is a finite number of geometrically different 
geodesies joining the initial point (north pole) P = (1, 0, 0, 0) G with Q = {z, w). 

Proof. Let us denote 

z = re'^\ w = pe'^\ C + iD = VC^TD^c'^ . 

Then from (I6.ip and (16. 2p we have that 

(6-5) = b2^1cKd^ sm\tVB^ + C^ + D^), and ^2 = Bt + 6, 

where t is the right end of the time interval s G [0, t] at which the endpoint Q is reached. 
We suppose for the moment that the angles s\J B'^ + C"^ + D'^ and tB are from the first 
quadrant. Other cases are treated similarly. Then we have 



B^±C^ + D^ , Bp . 



and 

^1 = — ^2 + arctan ^ 



The first expression in (16.51) leads to the value of the length parameter t as 



t = —^^^=^^^= arcsm p] 



and the second to 




^2 = + -y====== arcsm 




Substituting 9 in the latter equation we come to an equation which depends only on 



which we rewrite as 
(6.6) sin 




( 1 - (1 + P)p2 ) - 



or as an equation for the parameter k, which is the curvature of the geodesic at the 
initial moment. We through away the trivial cases k = and .^i = excluded from the 
theorem (see the remark before the theorem). 

Observe that — ^2 = (,1 ~ arctan ^ ^^^^^^^^2)^2 ^ is non-vanishing because B ^ from 

(16. 5p . So the left-hand side of equation (16.61) is a function of k which is bounded by 
1 in absolute value and fast oscillating about the point k = 0. The right-hand side of 
(16. 6p is an even function increasing for /c > 0, see Figure [21 Therefore, there exists a 
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countable number of non-vanishing different solutions {k^} of the equation (16.61) within 
the interval \k\ < a/ ^ — 1 = with a limit point at the origin. 



Figure 2. Solutions to the equation (16.61) 



However, in order to define all parameters B, C, and D we need to solve the equations 
(16. Sp . (16. 6p . and not all kn satisfy all three equations. Let us consider positive kn- We 
calculate the argument of z as 



^1 = —Bt + arctan 



B 



VB^ + C^ + D' 



: tan (t^WVC^^D- 



= —Bt + arctan 

< -knWC^ + 



knP 



knP 

V/1-(1 + A;2)p2 



On the other hand, we have 



^/ C2 I £)2 _ arcsin(pv/l + k^) ^ p 



t^TTkl 



t 



Observe that due to the remark before this theorem, > and < p < 1. Therefore, 
we deduce the inequahty 



or 



6 < knp 



knP > ^1 



v/l-p2(l + A;2) 



(6.7) 

'^i-V-^-p'ii + ki) 

The right-hand side of the inequality (16. 7p decreases with respect to /c„ > 0. 
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Set e = £ < + k'^) < 1, then immediately we have the inequahty 

kl > - 1) > 0. If < p2(l + k^) < e, then the inequahty ([621) imphes that 



kn > 6 . = > 0. 



FinaUy, we obtain 




kn > min <; ^,-^^^^—^£==-^, - 1) ;> = 6(6, p) > 0. 

This proves that all positive solutions to the equation fl6.6p must belong to the interval 
{b{^i,p), — 1), hence there are only finite number of such The same arguments 
are applied for negative values of A;„. □ 

Remark 7. If p is approaching 0, the point Q is approaching the vertical line and the 
value of kn becomes 

k - 

and the solution is reduced to the case considered in Theorem |2] with u = 6, i.e., the 
number of geodesies is increasing infintely. 

Remark 8. Given two points P and Q, we find the initial velocity by equation (16. 5p and 
the initial curvature by equation (16.61) . 

6.2. Hyperspherical coordinates. Let us use now the hyperspherical coordinates 

(6.8) xi + ix2 = e^'^^cosr], 

X3 + ix4 = e*^2sin?7, r] e {0,7r/2), Ci, C2 e [-tt, tt), 

to write the Hamiltonian system. 

The horizontal coordinates are written as 

sin 2?7 



T] cos(Ci - C2) + (Ci + C2) sin(Ci - C: 



2 



-7] sin(Ci - C2) + (Ci + C2) cos(Ci - C2, 



2 ' 
sin 2?7 



c = Ci cos^ V ~ C2 sin^ 1]. 
The horizontality condition in hyperspherical coordinates becomes 

Ci cos^ V ~ C2 sin^ ?7 = 0. 

The horizontal 2-sphere in Theorem [T] is obtained from the parametrization (16. 8p . if 
we set Ci = 0, C2 = = -5 or ^7 = — s. The vertical line is obtained from the 

parametrization (16. 8p setting rj = 0, (i = s. 

Writing the vector fields A^, Z, X, Y in the hyperspherical coordinates we get 

N = —2 cotan 27^(9^, Z = — 9^2, 
X = sin(Ci - C2) tanr]d(;-^ + sin(Ci - (2) cotanr/^ + 2 cos(Ci - C2)c^»), 
Y = cos(Ci - C2) tan?7% + cos(Ci - C2) cotan 779^2 - 2 sin(Ci - C2)<9,,. 
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In this parametrization some similarity with the Heisenberg group can be shown. The 
commutator of two horizontal vector fields X, Y gives the constant vector field Z which is 
orthogonal to the horizontal vector fields at each point of the manifold. In hyperspherical 
coordinates it is easy to see that the form uj = cos"^ rjdd — siri^ rid(2, that defines the 
horizontal distribution is contact because 

LU Aduj = sm{2r]) dr] A dCi A ^^(2 = 2(iV, 

where dV is the volume form. The sub-Laplacian is defined as 

^{X^ + Y^) = ^(tan^ r]dl + cotan^ r]dl + 49^ + 29^,%). 

The principal symbol is given by the Hamiltonian 

H{C,, C2, V, i^i,i^2,0) = ^(tan^ r]ijl + cotan^ r^tpj + 49^ + 2V^i7/'2), 

with the covectors ipk ~ f^Cfe' k = 1,2, 6 = 9^. It gives the Hamiltonian system 

Ci = ^ = ^1 ta^^ V + '^2 
C2 = ^ = ^^2 cotan^ r] + ipi 

V = f = 4^ 
^'■'^ ^1 = -f = 

^2 = -f = 

Q = 9H _ tan r? , 1,2 cotan r? 

6.3. Geodesies in hyperspherical coordinates. Let us find geodesies 

l{s) = {Ci{s),C2{s),r,{s)), [0,t] 

joining the points P = 7(0) = (Ci)C25'7o) and Q = 7(t) = (CbC2,''?)- They are obtained 
as projections of the solutions to system (16.91) onto the sphere. 
Observe that the system (16.91) is coupled and the system 

v = ^ = AO 

(in ' -L cos^ n ' ^ 



(6.10) ^ _ ' QH _ ,2 tanr? , 1,2 cotan t? 

dr) '^1 cos^ 77 ^2 sin"^ r) 

with the boundary conditions 77(0) = ?7o, ?7(t) = rj, is independent. 
Multiplying the equations of this system crosswise we obtain 

( ,2tanr7 ,2Cotanr7\ . 
\ cos^ 7] sm 1] J 

or 

Therefore, 

(6.11) Ae^{s) =4^o-^itan^r/(s) - ^"2 cot^ r/(s) + tan^ r^o + V2 cot^ r/o. 
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The constant 9q is a constant of integration which will be further expressed in terms 
of boundary conditions for P and Q. Let us substitute the expression for 9{s) in the 
second equation of the system f l6.10p . We obtain 



(6.12) i) = W = ±2^J Ael + iplta.n^riQ + %l)lcot^riQ - ipl ta^n^ ri{s) - ipl cot^ ri{s) . 

Observe that the expression under the square root is non-negative for all s G [0, t\. Let us 
consider the case of increasing rj and (+) in front of the square root (which is assumed to 
be positive). Negative case will be treated later. Changing variables u = sm"^ rj G [0, 1], 
we arrive at 

iit = ^Ju{l - m)(4^o + (^itan?7o + ^"2 cotr^o)^) - {i^iu + ^/'2(1 - u)y. 
The square polynomial under the root is reduced to 



cos^ r]Q 



+ 



sin^ TjQ 



+ 4^0 




cos^ riQ 



+ 



■ i — 

sm rjo 



+ 



u — 



sin rjo 



+ 



sin" »7o 

The polynomial is non-negative for all u G [0, 1], as it was mentioned before. Therefore, 

2 



+ 



—r^ 

sin rjo 



+ 



sin' »)o 



cos^ 770 



+ 



■ J — 

sm r)(j 



is non-negative too. Integrating (16.121) gives us 
srn^ r]{s) - \ 



(6.13) 



1 + 



sin(4sv A + const), 



4 ' A 

where we introduce the notation 



A 



+ 



sin^ r^o 



4^2 > 0. 



(6.14) 

cos^ ?7o 

It is convenient to use the constants = ■i/'i/v^, ^2 = V^2/v^, and A instead of t/'i, 
and Qq. Now we consider the sign (-) in front of the square root. Finally, our solution 
is written as 

sin2 7^(s) - 1(1 + ^2- Vi?) 



(6.15) 
where 



l(l + ^2_^2)2_^2 



sin(±4sv A + const), 



const = arcsm 



. sin2ryo-i(l+V^i-^?) 



+ 27m. 



i(l + ^2_^2)2_^2 
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Let us turn to the solution of the boundary value problem with the boundary condi- 
tions Ci(0) = (2(0) = 0, r/(0) = 7r/4, and Ci(t) = Ci, C2(^) = C2, v{t) = V- Observe that 
the chosen parametrization does not give us a chart about the north pole (1, 0, 0, 0). So 
we can shift the considerations by a left-invariant group action to any initial point, e.g., 
Xq = (1/v^, 0, 1/v^, 0). The horizontal geodesies starting from the point xq admit the 
form 

xi{s) + ix2{s) = —j= (cos s — COS a sin s -|- z sin a sin s) , 

X3(s) -|- 2x4(5) = (cos s -|- COS 0" sin s -|- z sin a sin s) , 
see Theorem [1] and the remark thereafter. In the hyper spherical coordinates it looks as 



cos 77(3) ~ Y 2 ~ ^'^^ ^ ^ ""^^ 

. ^ , , sin cr sins 

smCi(s) = , 
V 1 — cos cr sin 2s 

. , , , sin 0" sin s 

smC2(s) 



Vl + COS 0" sin 2s' 

where a is some constant from the interval [0, tt]. The horizontal surface is given by the 
relation sin(^i = sin (^2 tan 77. The vertical line is written as 

.,w-^, = .. & = 

Substituting s = and s = t gives us the expression oi A = ^("^(r^o, ^1, '^2-, t) as 

1 / sin^r]- i(l + V^|-?/'2) 

(6.16) A = —-{ arcsin- ' <^2 -/^i; 



16^2 



l(l+^2_^2)2_^2 



'2 

. sin^r^o-^l + ^/'i-^/'?) , ^ 
— arcsm — ^ ^ _ -|- 27rn 

^i(l + V^2-V^?)^-^2 

Then we find the parametric representation for the functions Ci{s) and C2{s)- Let us 
proceed by writing 

tan^ r7(s) = -1 H z ~ \ ^ ' 

1 - 1(^1 + ^2 _ ^2 j _ sin(±4sv^ + Di) 

where Dq and Di are the constants 



. sin2ryo-i(l+V^i-V^?) 
iJi = — arcsm 
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and 



cot^ r]{s) 



Integrating two first equations of tlie Hamiltonian system (16.91) gives 

Jo 



1 - 1(^1 + _ ^2 j _ sin(±4sv^ + Di) 



sVA{ip2 — i^i) + arctan — 



2 (1-^2+^? 



tan f ±2s\/A+ ^ 



Do 



-2 arctan — 



tan 



Analogously, 



(2(3) - C2 = sVA-ipi + VAip2 [ cot^ r]{s)ds 

Jo 

sy/Ai^ipi - V^2) + 2 arctan | ^ + ^2 " i'l) tan ^±2sVA 



£1 
2 



-2 arctan — 



V^2 



-i/;^ I tan 



£1 
2 



Let us study solutions starting at tlie point Xq = (1/^/2,0, 0), or Ci = C2 = O5 
rjo = 7r/4. Observe tliat tlie option ipi = ip2 = leads to the trivial solution Ci("5) = 0, 
(2(5) = 0, and ri{s) = ^^^s + 7r/4. If = and 7/^2 7^ 0, then Ci(s) = s^2VJ and 
C2(s), ''^(s) are calculated by the above formulas. 

As it has been shown in cartesian coordinates, there are infinite number of geodesies 
joining the point Xq with a point of the vertical line. In hyperspherical coordinates 
this corresponds to a point of the vertical line expressed as 77 = 7r/4, ^1 = — ^2. Then, 
A^"'^ = (^) , and the solution to the boundary value problem for the functions (li^) 

and C2('S) leads to 1JJ2 — tpi = ^ = for n 7^ 0. The case n = corresponds to the 
degenerate curve at initial point. Thus we have a countable number of geometrically 
different geodesies. The concrete choice of tpi and 1^2 fixes the rotation about the vertical 
line. 

In order to solve the boundary value problem in non-trivial situations we express 
implicitly tpi and tjj2 as solutions ^1^= ^{"''(C?, (2. ^70, Ci, C2, ??) = ^/'S"''(0, 0, 7r/4, Ci, C2, 
and 1IJ2 = ipi''\Ci, C21 Vo, Ci, C2, v) = V'^Ho, 0, 7r/4, (i, C2, v) to the equations 

Ci = t\^{i'2 -i'l) + 2 arctan ^ \\ ' i'2 + i'l) tan (^±2tVA + - Doj 



1 



2 arctan ■^\-[^ — i^2~^i'il tan ( — 



Do 
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and 

C2 = tVAiiPi -4^2) + 2 arctan ^ |^ + - V-i) tan (^±2t^/A + ^ j + Doj 

-2 arctan i | i (^1 + _ ^2 j ^^^^^ ^^^^ ^ | ^ 

where A is a solution A = A^'^\ipi, '4'2,f]o^ Vi ^) given by (16.161) . 
The Hamiltonian can be written as 

If the point is not at the vertical line, then the Hamiltonian is bounded as it was shown 
in the cartesian coordinates. Moreover, (1 — {^|Jl — V'2)^) > 0. Then, there can be only 
finite number of n that satisfy all boundary conditions. From this formulation it is 
easy to see which n and which sign in (16.161) we have to choose in order to define the 
minimizer. This is given by the condition of minimal value of A^"-\ In particular, for 
the vertical line, n = ±1. 

6.4. Modified action. We are aimed now at construction of the function / mentioned 
in Section 2. It turns out that ipi and ijj2 are the first integrals of the Hamiltonian system 
(16. 9p . which we assume to be given constants. The Hamiltonian system in the hyper- 
spherical coordinates suggests the form of the modified action whereas in the cartesian 
coordinates its possible form remains rather unclear. Let us solve (16.91) for the following 
mixed boundary conditions: 

77(0) = r]o, 7]{t) = r], Ci(t) = Ci, C2(t) = C2, 

(6.17) 

7/^1(0) = ^^!, V^2(0) =V'2. 

In the classical case the action is defined on arbitrary smooth curves which join two 
given points. In our case the non-classical (or modified) action is defined on solutions to 
the above Hamiltonian system where only the coordinate rj is given in two endpoints of 
the interval [0, t\. The coordinates (i and (2 are given only at the right-hand endpoint t. 
We are looking for the modified action in the form 

g{Ci, C2, m, V, ^1, ^2, t) = V'i(0)Ci(0) + ^2(0)C2(0) + / (^iCi(s) + ^2Us) + er]{s) - H)ds 

Jo 

t 



^^1(1 + ^2(2+ / {ei^{s)-H)ds 

Jo 



inspired by the work [9] . Observe also that what is written is nothing but the integration- 
by-parts formula. The function H does not depend on s on the solutions to the Hamil- 
tonian system (independently on boundary conditions), therefore we have 

t /■* 

g = ^iCi + V^2C2 - -((^1 tanr/o + V2cotanr/o)^ + 491) + / 4e\s)ds, 
^ Jo 

where ^0 is the constant of integration. In order to calculate our modified action we 

have to 

• calculate the integral; 
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• represent Oq, or equivalently A in terms of rjo, r], ipi, ip2- 

Let us remark here that we do not specify at the moment the value of 6q (or A) from 
the countable number of possible values given by f l6.16p . This will be done later in 
Section [HI 

Now let us calculate the integral in the modified action. The action g admits the form 



5' = ^iCi+V'2C2+7j((^itan?7o+^2Cot?7o) +46'o)-2t^i?/'2- / (^Ai tan r]{s)+'ip2Cot r]{s))ds 
^ Jo 



^iCi + ^2(2 + ^ii^i tanr/0 + ^2 cot r/o)' + 4^^) + ^(^^^ _ 



'0 yi-i^i 

We observe that 
and 



+ 



i ( 1 + ^ ) - Do MAsVA + A) i ( 1 + ^ 



Do sm{4sVA + D 



4 V A 



r)2 _ }tl n 
^0 — ^ 



2 V A 



Thus, integrating gives us 



arctan 



A 



2 V A 



tan [2t\fA + ^ j - Dq 



+2il)i arctan 



A 



^1 



2 V A 



tan Dn 

2 



-2^2 arctan ^ (l + ^ tan ("2^71 + ^ ) + Dq 



+2-?/'2 arctan 



The important particular case which we shall use in forthcoming sections is ip2 = —'ipi, 
that leads to a much simpler formula 

5((Ci,C2,7r/4, 77,^1, -V'l,^) = AiCi - C2) + 4~ + ~ 2?/'i arctan^ tan 4tVA. 
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7. Generalized Hamilton- J acobi equation 

Theorem 4. LetQi, (2, and r] be fixed, and let (i{s) = (i^s^ipi, 1^2X1X2, VyVo^^) (2(3) = 
(2{s;ipi,4'2,CiX2,V:Voy't), and rj{s) = ri{s;ipi,4'2,VyVojt) be solutions to the Hamilton- 
ian system fl6.9p with the mixed boundary conditions (16.171) and with the Hamiltonian 
H{(i{s)X2{s),ri{s),ipi,ip2,(){s)). The modified action 

^7 = ^iCi+^2C2+ fms)-H)ds 

Jo 

satisfies the Hamilton- Jacobi equation 

^ + //(Ci,C2,r7,V^?) = 0, 
where the gradient V is taken with respect to the coordinates of the endpoint (Ci)C2;''?)- 
Proof. Let us calculate the derivatives of g with respect to (i, ^2? and f] explicitly. 

^ de{s) ^ ^ ^^^^ d dr]{s) dHdr]{s) dHdO^s) 



dg , , 



5Ci 



ds d(i 



ds 



5Ci 



dr]{s) dCi de{s) dCi 
ds = ipi. 



ds 



We used that ^ = r^, £^ 



—6. Moreover, 77(5) does not depend on ^1 for s G [0,t]. 
Here f] means the derivative with respect to s. Analogously, 

dg 

0(2 

We continue with 



^2 



dg_ 
drj 



* ^d9(s) ^, , d drjis) dH dri(s 







dH dejs] 

drj ' ' ^ ds drj drj{s) drj d9{s) drj 

t 



ds 



ds 



9{s\ 



dr]{s) 


drj - 



ds = 9{s 



dr]{s) 



The latter derivative is taken with respect to t as 



dg_ 
dt 



{9{s)r] - H),=t + 



V + 9{s)—n{s) - 



dt 



dt 



{9{s)rj-H)s=t + 9{s 



dri{s) 



drj 

dH drj{s) 
drj{s) dt 

s=t 



dH d9{s] 
d9{s) dt 



ds 



dt 



We need to calculate 



drj{s) 



drj 



and 



drj{s) 



s=0 



dt 



s=t 



s=0 



Let us rewrite the equation fl6.13l) in the form 

Pirj{s),A) = AsVA, 
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where A = A^'^\^pl, 11)2, rjo, rj, t) satisfies the equation 
Then 

dP{rj{s),A) _ dP{r]{s),A)dr]{s) ^ dP{r]{s), A) dA _ 2s dA 



drj dr]{s) drj dA drj y/A dr] 

Substituting first s = t, and then differentiating with respect to rj we come to 

dP{ri, A) _ dP{7], A) dP{r], A) dA _ 2t OA 
drj drj dA drj y/A drj 

Substituting s = t in the first equation and subtracting the second one we obtain 

dri{s) 



drj 

Substituting s = in the first equation we get 
drj{s 



drj 



s=0 



dP{rj{s),A) dA fdP{rj{s),A) 
dA drj \ drj{s) 



-1 



0. 



s=0 



Analogously, calculating the derivative 

dPirj{s),A) 



and substituting s = we get „^ 

s=0 

rj{t;iJi,il)2,Vo,V,t) 







dt 

0. Finally, we have 

rj{s;i)i,iJ2,Vo,V,t) 



at 



rj + 



dt 



s=t 



which implies the relation ^ = —H{(i, (2,V^'^iy'^2,(^)- Now we are able to calculate 
-f^(Ci,C2,^/, V^) as 



— ) tan rj 



dg dg 



drj 



-{iPl tan^ 7] + iP^ cot^ rj + 2^iV^2 + ^0^)s=t = H{Ci, C2, V, V^i, ^2, ' 



dg_ 
' dt' 



□ 



This finishes the proof. 

Let us introduce the differential operator Tg = ^ + Vofi' ■ Vo, where g is the modified 
action and Vog is the horizontal gradient {Xg, Yg). The operator T was deeply studied 
by Beals, Gaveau and Greiner, see e.g., in [8]. Let 7(3) = C2('5), -^(s)), s G [0,t], 

be a geodesic, that is a projection of a solution of the Hamiltonian system onto the 
underlying manifold. Since ^ = ijji, i = 1, 2, || = ^, by definition, we have that the 
formal symbol of the vector fields X, Y defines the horizontal gradient of g along the 
geodesic: 



(X(7(s),V^,^(s)),y(7(s),^„^(s))) 



^^^^ ''dQ'drj''^^^ ''dQ'drj'^ 
Vo^(7(s)). 
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The projection onto the manifold defines the horizontal gradient of 7: 

(X(7),y(7))=Vo(7(«)). 

For any function h{(i, rj, t) let us define its value along a geodesic 7(5) = {(i{s),r]{s)) 
by h{s) = h{Ci{s),ri{s), s), s E [0,t]. Then the differential operator Tg{h{'y)) is the 
differentiation along the geodesic 7. Indeed, 

T.ihm = f («) + ^oKCi, V) ■ Vo(7)(«) = + ^oKCi, V) ■ Vo(^(7))(«)- 

Denote V/. = (f , f , f ) ,. 
Proposition 4. // a function h{Q,ri,t) satisfies the Hamilton-,] acohi equation ht — 

dt 



—H{yh), then its derivative ht{Ci,r],t) = ^^'•1"^''*^ possesses the properties: 



dh 

Th{ht) = + Vo/i • Voht = 0, 

and 

(7.1) Tn{h) = -ht. 

Proof. If the Hamilton - Jacobi equation is satisfied for h, then 

Applying the operator T to h we obtain 
dh 

Th{h) = — + Vo/i • Vo/i = -H{Wh) + 2H{Vh) = H{Vh) = -ht. 



□ 



Observe that the modified action satisfies the stretching property 

y(Ci, C2, ^0, r], -01, -02, t) = Xg{Ci, C2, ^0, ^' y ' y ' ^^)' 
and construct the function 

/(Ci, C2, Vo, V, "01, "02) = ^(Ci, C2, Vo, V, "01, "02, !)■ 
Theorem 5. The function f is a solution to the generalized Hamilton-Jacohi equation 

Proof. By the above stretching property of the function g we have 

^(Ci,< 

Therefore, 



1 1 

^(Ci, C2, V, i'l, i'2, t) = -c/(Ci, C2, vo, v, ti'i, ti'2, i) = y/(Ci, C2, vo, v, ti'i, ti)2). 



dg 1 , 1 f , df Bf 



dt t^' t y dijji d^2. 
for any fixed t, in particular for i = 1. On the other hand g satisfies the Hamilton- Jacobi 
equation. This finishes the proof. □ 
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8. Modified action as a distance function 



Theorem [5] implies that if tpi and ip2 are critical points for the modified action /, then 
/ is equal to the Hamiltonian H{(i, (2, ^ f)- This allows us to interpret / as a distance 
function. 

Theorem 6. Suppose that the endpoint C^i, (2 o-nd rj does not belong to the vertical 
line passing through the initial point P = (0,0, r/o). Among all critical points ipi = 

^i"''(Ci,C2,^o,'7) andip2 = i'i''\Ci,C2,Vo,v) of the modified action /(Ci, C2, ^?o, V^i, ^^2), 
i.e., those points satisfying the equations df/dipi = and df /dtp2 = 0, there exist 
exactly one such that the action f evaluated at this critical point is a distance function 
from the point P = (0,0, r^o) to Q = (Ci;C2)''?)- Every such critical value and il)^2^ 
defines a unique geodesic joining P and Q. 



Proof. Let us calculate the derivative 



dl_ 



Ci + 



d9{s] 



r] + e{s) 



d drj{s) 



We need to calculate 



Ci + 0{s 



dr]{s) 



ds dipi 
drj{s) 



dH 

Ik 



dH d7]{s) dH d9{s] 



s=t 



s=0 



dri{s) d^^i 

* dH 



de{s) dipi 



ds 



and 



dri{s) 



s=0 



dip 



s=t 



-ds. 



Similarly to the previous section we use the derivatives of the function P{ri{s), A) as 



dP{v{s),A) 
dipi 

Substituting s = 



dP{7]{s), A) ^ dP{r]{s),A) dr]{s) 



dipi ' dri{s) dipi 
in the latter equation we get 

dri{s 



+ 



dP{T]{s),A) dA 2s dA 



dA 



d%l)i 



Adipi 



0. 



Consider now the derivative 
(9P(r/,A) 

dipi 
dP{r^{s),A) 



Then 
Hense, 

Therefore, 
(8.1) 



dipi 



s=t 



dipi 

s=0 

dP{T], A) dP{7], A) dA _ 2t dA 

dipi 

dP{r],A) 

dipi 

dri{s) 



dA dtp, ^/AdtPi 
dP{r]{s),A)dr]{s) 



dr](s) dipi 



dipi 



0. 



dl_ 

dipi 



Ci- f Cids = Cl = ^. 
Jo 
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Analogously, 

(8.2) If = - /' C2ds = = 0. 

dip2 Jo 

On the other hand, the equations (18.11) and (18. 2p can be rewritten in terms of the function 

ri{s) as 

df df 

Ci- {^itan^v{s) + i^2)ds = 0, —^=(2- (^2 cot^ ??(s) + ^Ai)cis = 0. 



d^pi Jo ' d^/j2 Jo 

The critical points ipi = V'l^HCi; C2, ''?0) ''?) and 1^2 = V'2"''(Ci) C2, ^70; ''?) are defined as 
solutions to the above system of two equations, which is the same as the system which 
defines reparametrization of geodesies for Ci = C2 ~ 0- Thus, every critical point 

ipi = '?/'i"^(Ci) C2, ''70! ^7) and 1^2 = ^2"^(Ci) C25 ^70) ''?) defines a unique geodesic starting at 
the point P and ending at the point Q as stated in the theorem. Since the point Q does 
not belong to the vertical line, there is a finite number of geodesies joining P and Q, 
see Theorem [31 We choose the geodesic which minimizes the Hamiltonian (C^ + in 
terms of Theorem [3]). Thus, the function / evaluated in its critical points corresponding 
to this geodesic satisfies all the properties of a distance, i.e., non-negative, vanishes if 
and only if P = Q, and satisfies the triangle inequality. □ 

We consider now the modified action / restricted to the characteristic variety in the 
cotangent bundle defined by ipi = t, ip2 = — Ttan^r^o, ^ = 0. This variety is a singular 
set because the Hamiltonian H vanishes there. The modified action does not depend 
on the variable 6 of the tangent bundle. Choosing the initial point (0,0,71/4) in the 
phase manifold with coordinates {(1X2, 1])^ we set ipi = t, "^2 = —t- Let us suppose the 
sign (+) in all formulas for the modified action. This simplify significantly the analytic 
expression for / which becomes of the form 

/(^i,V^2,Ci, (2,^,^0) = f{r, -r,Ci,C2,??,vr/4) 
= ^(Ci - C2) + -A + 2t^ - 2t arctan 4 



2 \^ -tan2 2v^^ 

^(Ci - C2) + -A + 2r^ - 2r arctan f ^ tan aVa] 
2 VVI / 



where A > 4r , and satisfies the equation 



sin^r/ = ^ + (smAy/A)^^ - ^. 

Among the infinite number of the solutions to this equation we choose the first one. It 
gives the minimum to the Hamiltonian. We see that the action /(r, — r, ^1, (^2? ''7) 7r/4) 
has singularities at all points 

1 , 

r = ± — (vr + 2Tcn) sin 2?]. 
16 

However, the term is dominating and the function exp(— /) exponentially decays 
as r ^ ±00 and integrable. This contrasts the case of non-compact sub-Riemannian 
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manifolds considered earlier in, e.g., [6], [H [9], [18], where the authors had to avoid non- 
integrable singularities introducing complex modified action. 

9. Volume element 

The aim of this section is to deduce the transport equation for the volume element 
that serves for the heat kernel, and to find the fundumental solution to the sub-Laplacian 
equation in the case of 3-D sub-Riemannian sphere. 

9.1. Volume element for the heat kernel. We shall use the notation of Sections H] 
andO Choose the point (0,0, j) as the center for the heat kernel just to have simpler 
formulas. The characteristic variety is the straight line given by 

= r cotan rj 
= —Ttanrj 
= 

We start from the volume element v for the heat kernel. Let / be the modified action 
studied at Section [6], [3, [HI We remind that it can be considered as the square of the 
distance from the point (0, 0, ?7o), and in particular, from r^o = f to some point (Ci, C2; v)- 

Let us integrate the function e~" over the characteristic variety at (0, 0, j) with respect 
to a measure v{(i,(2,V^'^)- The characteristic variety at (0,0,^) gives us the relation 
between ipi and 1IJ2, namely, ipi = —ip2 = t. Since / satisfies the generalized Hamilton- 
Jacobi equation for any ipi,'ip2, we have the equation 

(9.1) + H{Ci, C2, V, r, V/) = /(Ci, C2, V, r), 

where we write = (^^i-§^ + ^"2^ j lvi=-V'2=r- Let us look at some interesting 
properties of /(t). Define /(Ci, rj, r, — r) = Th{(i, r], r), i = 1, 2 and denote fr = '^'^^^'^"^^ , 

h - 9h _ fdf_ 9/ a/\ X7h - (9h. dh_ dh\ 

Proposition 5. Under the above mentioned notations the following properties hold: 

(i) the generalized Hamilton- Jacobi equation (19.11) for f implies that h satisfies the 
Hamilton- Jacobi equation; 

(ii) fr = -TH{Vh) + h; 

(iii) fr = rhr + h = 0; 

(iv) T,(/,) = ^ + Vo/i-Vo/. = 0; 

(v) Th{f) = i + Voh-Vof = h-Th. 

Proof. In order to prove (i) we have to show that |^ + H(Vh) = 0. Indeed, 

df dh dh 

^£-f = -Hi^f) T{h + r—)-Th = -r^H{Vh) _ + if(V/i) = 0, 

since the Hamiltonian is a homogeneous function of order 2 with respect to V/i. In order 
to prove (ii), we write 

fr = -{- HiVf) + f)= -TH{Vh) + h. 
T 
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Then, if(V/i) = —h^- implies (iii). 

Observe that the derivative of the operator Th in (iv) is understood as a complete 
derivative of / with respect to r: '^•^^^'"^^ . Moreover ^+Vo/i-Vo/i = Thh, and if h satisfies 
the Hamilton-Jacobi equation, then Th{^) = and Th{h) = —hr by Proposition |H 
Thus, 

ThUr) = ThirK + h) = K + TTh{K) + Th{h) = 0. 
In order to prove (v) we exploit the Hamilton-Jacobi equation for h. Just calculate 



TJf) = — + Voh ■ Vo/ = h + Thr + 2TH{Vh) = h + tK - 2rhr = h- tK. 
dr 



□ 



For simplicity we follow the ideas of [71 [23] , and assume that the volume element v is 
represented as f = Vjp = VE, where E = Then, let us look for the heat kernel in 
the form 

(J r+oo 

(9.2) P^{(^X2,V) = - J e-^^V{C,,(2,V,r)E{C,,C2,V,r)dT. 

Let us deduce the transport equation for f (Ci, (2, ''")• The relation 

(Ax - ^)Pu{Ci, C2, V) = C j (Ax- ^) (u-'^e-^^^'^{VE){Ci, C2, V, r)) dr, 
is to be satisfied. One calculates 



(9 / _ /(Ci.C2.'?.^) . A /e ^{VE)\/ f 

and 

Ax(rt^"(V^^)) = ^(^ - iVE)Axf -Vof -VoiVE) 

(9.4) + i^(/-r|)+.Ax(Ki?)), 

where Vq/ = {Xf, Yf) stands for the horizontal gradient. The Hamilton-Jacobi equa- 
tion yelds 

l|v„/r = ff(v/) = /-4. 

Subtracting fl9.3p from 09.41) we arrive at 

^^-■'-li^^) = (^)((«-A./)a/E)-Vo/.V„(VB) 

u dr / 

Substituting the term —^e^i{VE)Tj^ from the equality 

1 ,1,,,^, df Of _/,,^^, \ _/ _id{VE) 



--e-hvE)T%- = ^(e'hVEW) - (VE)e-^ - re"- ■ 

U dTOT\ / 



dr 
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one deduces 

(Ax-|^)(^:^^) = {^){{,-l-A,f)iVE)-Vof-VoiVE)-r 



d{VE) 
dr 



(9.5) 



+ nA^{VE))+-±,^[e-ir{VE) 



Let us write /(r) = rh^r). Set Th = + Voh ■ Vq. The derivative |^ is thought of 



as the derivative '^^ = fr- In more condensed form we write 



dr 



-Vo/ ■ WoiVE) - = + Vo/i ■ Vo{VE)^ = -rTniVE). 

Substituting E = fr we get 



by (iv). Now (19.51) takes the form 



(Ax- 
(9.6) 



du' 



e " 



fr 



+ -^^{e-^T{VE)] 



{q-l-/^xf){V)-TTn{V) +uAx{VE) 



ui+^ dr 



In the following step we observe that 



JL 

dr 



+ 



A[(g-l-Ax/)(\/)-rT,(\/) 
^((g-l-Ax/)(l^)-rT,(V) 
^)|:((g-l-Ax/)(\/)-rT,(\/)) 



and substitute the result into (19.61) . This leads to 



(9.7) 



e " 



d 



(g - 1 - Ax/) (l^) - rr,(V) + /^xiVfr 



1 d 
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Working with the first term one obtains 



1 dV 
{q - l-Axf)V-rT,{V)\+Ax{Vfr) = -{Axfr)V+{q-l-Axf)-g;^ 

- n{V) - {n{V)) + UAxV + VoV ■ Vofr + VAxfr 

dV dV dV 
= (g - 1 - Ax/)^ - ^ - Vo/^ ■ VoV - rn{—) - rVoK ■ VoV 

+ frAxV + VoV-Vofr 

= (g - 2 - Axf) ^ + Vo^ ■ (Vo/. - Vq/i - tVoK) - rTh{^) + f^AxV 

dV 

= {{q-2)-{TTn + Axf))^ + frAxV. 
Substituting the last expression into (19.71) we finally deduce 

(9.8) + -—{{e-^){Tn{V) + {Axf-q + l)V) 

If we were suppose that e'^rfrV, (^rTh^V) + {Axf — q + ^)V^ tends to as 
r ±oo, and the function V satisfies the transport equation 

dV 

(9.9) ((g - 2) - (rT, + Ax/)) ^ + /.Ax^^ = 0, 

then the heat kernel Pu{CiX2,i]) would be found in the form (19.21) . Observe that we 
did not use any specific form of the auxiliary function h. It is sufficient that h satisfies 
the Hamilton-Jacobi equation. Take the modified action g{CiiC2iVi'4'ii the 
function h{T) . 

Let us present the coefficient Axf- Since ^ = ipi, ^ = ip2, |^ = ^) 'we have 
Axf = 2|^ = 2|^. For the function 9 the expression 

(9.10) e"^ (ri) =9l-T^ cotan^ 2r/, 
is valid, where 6q can be found from the equation 



(9.11) cos277 = ^/-^sin8y'^^, 

where we take into consideration the sigh (+) in the solution (16.151) . Differentiat- 
ing (I9.10p one finds 

dOiv) ^ 1 fde^ ^ cos2r/ 
dr] '29{r]) \ dr] sin^ 2r] 
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Expression (19.111) gives 

del 4(r2 + ^2)sin2r/ 



Observe that 



sm 

and 

This imphes 



del _ AI.t'^ + el)ta.n2-q 



dr] ±8y^Pm?2^-r- - ^ 



2 ' 



-2 _ . 

which leads to the sub-Laplacian 

^^^^ 1 (^1^2 cos 2r/ ^ 4(r2 + ^2)t^^2r7 



^(r/)V sin^2r7 iS^^gtan^ 2r] - r"^ - 



-til 



where e(r]) is given by (I9.10p and can be found from (19.111) . Since the coefficients of 
the transport equation given by A^/ depend on r/, we can not assume that V depends 
only on r contrasting with the case of nilpotent groups. In fact, it depends also on 77, 
and we have to take into account the term Vo5' • Vq^ in the transport equation. Since 
the vector fields X and F, and the functions /(Ci, C2, t, — t), and 5'(Ci, C25 f]-, i^i, —i^iyV) 
depend only on t] and the difference (i — (2, the coefficients of the transport equation 
depend only on r] and Ci ~ C2- We expect that the solution of the transport equation V 
will be a function of r, rj, and (i — (2- This assumption makes the problem of finding 
volume element on §^ much more difficult, than in the case of nilpotent groups, where 
the solution of the transport equation was a function only on rj. 

9.2. Volume element for the Green function. Following the geometric method 
elaborated by Beals, Gaveau, and Greiner, we suppose that the fundamental solution of 
the sub-Laplacian equation with the sub-Laplacian Ax = X'^ + Y"^, has the form 

(9.12) KiC^,VoX.v)= r^^fj^dt, 

where w is the volume element over the characteristic variety at (C°, tjq) which is just 
the straight line in our case. The function g is the modified action defined in Section [6l 
satisfying the Hamilton- Jacobi equation. In [7j the authors elaborated the method of 
finding the volume element for the two step groups. Applying to our case, two step 
means that the matrix 



~luji[X,,X,])=^l I 

is non-singular at every point. Here [Xj,Xj] are all possible commutators of X, Y, and 
u is the one-form (13. 3p . Here we give only a general scheme referring the reader to [7J 
for the details. 
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Assume that the volume element w is written as w = W£, with £ = -^ = H{Vg), 
where we keep the notations of the previous subsections. In order K to be the Green 
function, we verify 



0=1 Ax{ ]dt 

^ 9 



(9.13) = ^AAwe)_v,s.v,(we)^2weH(v,).^ 

\ g g^ ^ 

Applying the Hamilton-Jacobi equation and integrating by parts twice, we continue fl9.13p 
as follows 



/+00 
£Ax{W) + {Tg + Axg) 
■oo 



-oo 

;+°° d (WE\ , 

-oo 

r" + 00 



dW 



dt 

g 



dt \ g^ ) 

d_fT^iun+^yog)W\ 

dt\ g J ' 



are suitable to satisfy and — — ^ >■ as t ^ ±oo. One comes to the 



Then, similarly to the case of the heat kernel, we assume that g, S = -g, and W 

li^ ^ and 

9 a 

conclusion that if W satisfies the transport equation 

X dW 

EAx{W)+{T, + Axg)^ 
then the Green function is given by fl9.12p . 
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